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Summary  of  Efforts 

The  general  focus  of  this  effort  involved  investigation  of  sensory  processing,  navigation, 
guidance  and  motion  control  mechanisms  that  are  the  basis  of  insect  flight.  The  effort 
utilized  modeling,  data  analysis  and  simulation  in  an  attempt  to  develop  basic  paradigms 
and  models  with  attention  to  the  possibility  of  using  similar  paradigms  in  the  design  of 
autonomous  flying  vehicles. 

A  large  body  of  literature  on  insect  flight  indicates  that  insects  utilize  unsteady 
aerodynamics  to  achieve  flight  performance  beyond  that  predicted  from  classical 
aerodynamics  theory.  Aerodynamic  models  have  not  yet  been  developed  from  the 
abundant  force  and  moment  data  that  has  been  collected  from  tethered  flying  insects  or 
from  hardware  models  that  replicate  the  kinematics  of  insect  flapping.  These  models 
which  most  likely  will  involve  flight  dependent  parameters  (lift,  drag)  in  an  innovative 
manner,  are  essential  for  simulating  flapping  flight  and  for  developing  an  understanding 
of  the  incredible  robustness  evident  in  insect  flight  response.  The  research  entailed  initial 
efforts  on  development  of  an  aerodynamics  model,  suitable  for  eventual  simulation  of 
insect  flight,  based  upon  existing  force  and  moment  data  taken  in  the  Dickinson  lab  at  UC 
Berkeley  The  huge  DoD  investments  in  micro  air  vehicles  that  utilize  micro-sensors  and 
actuators  for  active  flow  control  motivate  research  extending  our  understanding  of  how 
insects  exploit  unsteady  aero  for  flight. 

Insects  exhibit  extraordinary  navigation,  guidance,  and  control  capabilities  in  their  free 
flight  response  to  visual  stimuli.  On  going  research  in  this  area  (e.g.,  Dickinson),  and  in 
insect  gaze  stabilization  during  flight  (e.g.,  Gilbert),  involves  reconstruction  of  free  flight 
trajectories  from  3D  high-speed  video.  Although  biologists  are  a  long  way  from  obtaining 
sufficient  neurophysiological  data  for  developing  a  detailed  understanding  of  the 
guidance  and  control  system  design  features  of  insects,  the  flight  trajectory  data  may  be 
used  to  infer  models  that  represent  free  flight  response.  This  research  area  involves 
development  of  guidance  models  from  the  recent  high  quality  trajectory  data  and  making 
comparisons  with  those  previously  reported  in  the  biological  literature  (e.g.,  Ohlberg). 

During  the  early  phases  of  the  research  period,  the  investigators  collaborated  with  J. 
Evers  and  his  associates  in  considering  the  above  aspects  of  insect  flight  modeling.  A 
determination  of  priorities  and  feasibilities  was  made,  after  which  specific  efforts  focused 
on  detailed  investigations. 

During  the  summer  of  2000,  Emily  Ditter  (the  graduate  student  supported  by  this  grant) 
began  working  with  H.T.  Banks  to  model  die  forces  generated  by  the  flapping  wings  of 
fruit  flies  as  part  of  an  on-going  United  States  Air  Force  project.  Johnny  Evers  at  Eglin 
Air  Force  Base  in  Florida  had  been  working  with  Dr.  Michael  H.  Dickinson  (University 
of  California,  Berkeley)  to  determine  this  model  for  implementation  in  the  design  of 
unmanned  air  vehicles. 


Her  efforts  began  with  a  6  week  stay  at  Eglin  Air  Force  Base  to  conduct  research  jointly 
with  J.  Evers  and  study  the  data  provided  by  Dr.  Dickinson.  After  studying  fruit  flies.  Dr. 
Dickinson  and  his  team  developed  a  robotic  fruit  fly  wing  that  was  suspended  in  oil.  This 
wing  replicated  the  kinematics  of  the  fruit  fly  wing,  enabling  force  measurement  data 
collection  using  sensors  placed  about  the  wing.  Dr.  Dickinson  measured  the  forces  for 
several  different  wing  beat  scenarios  and  forwarded  the  data  to  us. 

Our  efforts  began  by  studying  the  actions  of  the  fruit  fly  wing,  trying  to  incorporate  as 
much  of  the  real  life  movement  into  our  model  as  possible.  The  fruit  fly’s  wing  sweep  is 
actually  quite  complicated  in  that  it  is  .not  just  a  back  and  forth  motion.  The  wing  sweeps 
forward,  and  upon  reaching  the  front  of  the  fly,  rotates  and  sweeps  backward  again.  The 
fly  is  in  control  of  when  this  rotation  happens  and  at  what  angle  and  speed  it  rotates.  The 
fly  can  also  sweep  its  wings  at  varying  speeds,  angles,  and  lengths  of  arcs.  We  felt  that  all 
of  these  factors  and  their  interdependence  were  important  in  developing  our  model. 

We  created  a  model  that  looked  at  the  changes  of  lift  and  drag  as  a  function  of  eight 
different  parameters.  These  parameters  depended  on  the  angles  subtended  and  the  angular 
velocities  of  the  wing.  We  developed  code  in  Matlab  to  represent  this  model  and 
performed  optimization  simulations  on  the  parameters  to  fit  the  experimental  data. 
Unfortunately,  the  optimum  parameter  set  did  not  accurately  represent  the  data,  leading  us 
to  pursue  an  alternative  approach.  This  consisted  of  a  model  reduction  approach  based  on 
experimental  data. 

We  focused  on  an  approach  called  Proper  Orthogonal  Decomposition  (POD). 
Mathematicians  and  scientists  have  used  POD  in  a  number  of  different  applications  such 
as  fluid  flow  analysis  and  the  modeling  of  thin  film  formation  using  Chemical  Vapor 
Deposition.  We  hoped  to  retrieve  supplemental  data  from  Dr.  Dickinson  that  would  show 
the  force  fields  generated  by  the  wings,  allowing  us  to  use  POD  to  create  a  reduced  order 
model  of  these  force  fields. 

While  waiting  for  this  data,  we  decided  to  test  the  POD  approach  on  a  similar  set  of  data 
(that  was  readily  available)  involving  flow  in  a  constrained  passage  way.  We  obtained 
data  that  consisted  of  many  sets  of  nasal  airway  passage  cross-sections  of  rhesus 
monkeys.  This  study  was  successfully  completed  and  its  results  are  given  in  the  M.S. 
project  paper,  “Representation  of  Nasal  Airways  Using  Proper  Orthogonal 
Decomposition”  by  E.  Ditter.  In  the  study,  we  demonstrated  nasal  airways  can  be 
represented  by  a  small  number  of  orthogonal  components,  thereby  giving  a  model  for  the 
airway  that  is  smaller  and  easier  to  deal  with  than  the  entire  system.  Details  of  the 
approach  and  specific  results  are  given  in  the  report  attached  as  Appendix  1. 

Although  suitable  fruit  fly  data  was  not  obtained  during  the  course  of  our  efforts,  we 
believe  that  POD  may  be  a  viable  approach  to  modeling  the  flight  of  fruit  flies  and  should 
be  pursued  in  the  future. 
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1  Introduction 

Working  with  images  often  requires  the  use  of  large  fields  of  data.  The  objective  of  this  study  is 

to  represent  large  data  fields  with  a  reduced  set  of  data  using  Proper  Orthogonal  Decomposition 

(POD).  POD  has  been  previously  used  by  M.  Kirby  and  L.  Sirovich  to  study  patterns  that  occur  in 

images  of  human  faces  [9,  13].  This  study  implements  POD  to  reconstruct  human  nasal  airways. 

* 

2  Nasal  Airway  Data 

Nasal  airways  can  be  visualized  through  a  series  of  two  dimensional  cross  sections  taken  through¬ 
out  the  air  passage.  Actual  cross  sections  are  obtained  using  Magnetic  Resonance  Imaging  (MRI) 
technology.  In  humans,  the  nasal  passage  is  separated  by  the  septal  wall,  which  extends  from  the 
nostrils  to  the  pharynx.  The  septal  wall  separates  the  right  and  left  airways,  which  are  almost  mirror 
images  of  each  other.  The  wall  ends  at  the  pharynx,  where  the  two  airways  join  to  form  one.  At  the 
nostrils,  the  cross  sections  are  close  to  oval  in  shape.  As  one  travels  through  the  airways  toward  the 
pharynx,  the  cross  sections  elongate  and  individualize,  (see  Figure  1.) 

Airflow  and  absorption  patterns  are  intimately  connected  to  nasal  shape  [10,  6,  14],  therefore, 
a  method  for  describing  nasal  shape  is  needed.  In  the  future  this  method  may  be  used  to  help 
identify  subpopulations  through  correlations  between  nasal  shape  data  and  predicted  susceptibility 
to  inhaled  toxicants. 

2.1  Data  Description 

Two  dimensional  cross  sections  (as  depicted  in  Figure  1)  were  obtained  from  seven  male  and  seven 
female  nonsmoking  adults.  Each  subject  contained  a  different  number  of  cross  sections  as  shown  in 


a  3  u  a  {  i  .  . 

Figure  1:  Alternating  right  and  (flipped)  left  airway  cross  sections  from  Sample  02.  The  first  and 
second  cross  sections  are  the  right  and  left  airways  at  the  pharynx,  respectively.  The  third  through 
sixth  cross  sections  are  of  the  airway  between  the  pharynx  and  the  nostril.  Cross  sections  seven  and 
eight  are  the  right  and  left  airways  at  the  nostril,  respectively.  Cross  sections  shown  are  eight  out 
of  fifty-four  available  sections  of  Sample  02.  (Left  cross  sections  have  been  flipped  for  comparison 
purposes.) 


Table  1.  The  collection  of  cross  sections  from  one  subject  will  be  referred  to  as  a  sample. 

Table  1:  Number  of  cross  sections  per  sample 


Sample 

Cross-sections 

02 

54 

03 

58 

06 

56 

07 

56 

08 

54 

09 

50 

10 

52 

12 

44 

14 

60 

15 

52 

16 

56 

17 

56 

18 

58 

19 

52 

The  acquired  MRI  images  were  hand  digitized  from  the  gray  scale  images  and  stored  as  3D  co¬ 
ordinate  data.  For  comparison  among  individuals,  the  original  (xyz)  coordinate  data  for  each  cross 
section  was  translated  and  scaled  to  nondimensianal  ix’y’z’)  coordinates. 
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(x  -  Xo)  , 
2  W  ’  y 


(y  -  yo) 

H  ’ 


and  z' 


z 

L 


(1) 
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where  the  values  of  W,  H,  and  L  were  determined  for  each  subject:  L  was  the  length  of  the  septal 
wall,  W  was  the  maximum  width  among  the  cross  sections,  and  H  was  the  height  among  cross 
sections.  The  translation  values  xo  and  yo  corresponded  to  the  minumum  x  and  y  coordinates 
within  each  right  or  (flipped)  left  cross  section.  For  each  subject,  the  relative  size  among  cross 
sections  was  maintained,  though  the  aspect  ratio  was  changed.  The  relative  size  among  subjects 
was  not  maintained.  Values  for  W,  H,and  L  are  shown  in  Table  2. 


Table  2:  Subject  gender  and  scaling  data 


Sample 

W  (mm) 

H  (mm) 

L  (mm) 

Gender 

02 

14.0 

43.3 

78 

male 

03 

13.6 

45.9 

84 

male 

06 

18.9 

53.0 

81 

male 

07 

17.7 

47.1 

81 

male 

08 

15.5 

41.6 

78 

male 

09 

17.0 

39.1 

75 

female 

10 

17.3 

38.8 

75 

female 

12 

15.9 

43.2 

63 

female 

14 

18.1 

50.6 

87 

male 

15 

14.4 

42.0 

75 

female 

16 

18.1 

44.6 

81 

female 

17 

18.4 

49.7 

84 

male 

18 

?? 

?? 

?? 

?? 

19 

15.9 

49.6 

75 

female 

Each  cross  section  is  a  75  x  150  array  of  binary  data  which  is  viewed  on  the  plots  in  black  and 
white.  Each  element  of  this  data  will  be  referred  to  as  a  pixel. 


3  Method 


Proper  Orthogonal  Decomposition,  also  known  as  Principal  Component  Analysis  and  Karhunen- 
Lofeve  Expansion,  is  a  method  used  to  represent  large  (possibly  nonlinear)  data  fields  with  a  rela- 
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tively  small  number  of  elements.  Proper  Orthogonal  Decomposition  creates  a  basis  set  which  spans 
the  original  data  set  by  capturing  the  characteristic  elements  of  the  data.  The  majority  of  these 
characteristics  are  usually  captured  in  the  first  few  POD  elements,  and  therefore,  the  data  system 
can  often  be  represented  well  by  these  first  few  elements. 

Proper  Orthogonal  Decomposition  has  been  used  with  many  different  applications  including  , 
Chemical  Vapor  Decomposition  Reactors  [3,  7,  8,  12],  Raleigh-Bernard  Convection  [11],  open  cavity 
acoustics  [4],  evaluation  of  material  integrity  [2],  control  of  beam  vibrations  [5]  and  characterization 
of  human  faces  [9,  13], 

3.1  Mathematical  Background 

The  data  must  be  gathered  in  snapshots.  A  snapshot  is  a  single  set  of  data  at  a  certain  physical 
parameter  (time,  distance,  Reynolds  number,  etc.).  For  our  purposes,  snapshots  will  be  taken  three 
millimeters  apart.  Each  snapshot  appears  as  a  cross  section.  Let {Ui(x)  :  1  <  i  <  N,x  6  D)  be  the 
set  of  N  snapshots  on  the  domain  Q.  The  average  of  the  snapshots  is  given  by: 

0  =  (2> 

4=1 

We  concentrate  on  each  snapshot  s  deviation  from  the  average,  since  this  leads  to  a  more  efficient 
approach,  and  follows  the  procedure  of  past  works  [9,  13, 11].  Our  new  snapshots,  Wit  i  =  1, ...  ,1V, 
are: 

Wi  =  Ui-U,  V  i  =  1,...,JV  (3) 

We  want  to  form  POD  basis  elements  which  most  closely  resemble  our  snapshots  in  the  L2  sense 
that 

(4) 


4 


is  maximized,  subject  to  ($,$)  =  ||$||2  =  1.  Note  that  (*,*)  and  ||  •  ||  are  respectively  the  L 2 


inner  product  and  norm  over  H.  We  choose  the  following  for  the  POD  basis  elements: 

N 


$  = 

i=l 

where  a*,  i  =  1,  2,  N ,  are  chosen  such  that  $  maximizes  equation  (4). 

We  define,  as  in  [12], 

1  N  f 

K(x,y)  :=  -i  £  W^x)*^)  and  R4>  :=  /  K{x,y)${y)dy, 

Nl=t  Ja 

where  R  :  L2  -+  L2.  Then  we  find  that 

(x)$(x)dx 

Jn 

=  K(x,y)$(y)dy$(x)dx 

Jn  Jn 

=  jjJlJnfoWi(x)Wi(y)*(y)dy<t>(x)dx 

=  *£iw>*)i2 


(5) 


i—l 


Furthermore, 

(R<f>,V)  =  ($,s$),  v$,^e  L2 

Since  R  is  a  nonnegative  symmetric  operator  on  L2(fl),  we  can  compare  the  problem  of  maximizing 

the  quantity  (4)  to  maximizing  the  eigenvalue  problem  =  A$,  subject  to  ||4>||2  =  1. 

,  N 

max  jj  53l(Wi(x),$)|2  =  max(fl$»$) 


t=l 


=  max(A$,$) 
=  maxA||$|| 
=  max  A 
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So?  we  are  seeking  the  maximum  eigenvalue  to  the  eigenvalue  problem  f£#  =  A#  subject  to  ||#||  =  1. 
Therefore, 


=  R9  =  [  K(z,y)$(y)dy 
Jq 

Substituting  equation  (o)  and  the  definition  of  K  into  equation  (6),  we  have: 

r  i  N  & 

yn  jy  E  wi(x)wi{v)$(y)dy  =  UiWii x) 


(6) 


/  jf'Zwi(x)Wi(3f)j2^Wk(y)  dy  =  A  £>Wi(») 

Q  i=  i  k=i  i=i 

N 


i=l 

N 


N  fl  f  \ 

E  E  V  /  %  a* 

*=1  U=1  ^  / 


W,-(x)  =  A][>Wi<*) 


1=1 


We  can  rewrite  this  as  another  eigenvalue  problem  CF  =  XV,  where 


Qk  =  —  j  W l(y)W k(y)dx  and  V 


ai 


(in 


The  covariance  matrix,  C,  is  a  nonnegative  Hermitian  matrix  [1]  and  has  a  complete  set  of  orthogonal 


eigenvectors, 


■ 

- 

r  i 

a\ 

a? 

II 

- 1 

...  ^ 
e 

,  v2  = 

i 

d 

II 

a%  _ 

with  corresponding  real  eigenvalues,  Ax  >  A2  >  •  •  •  >  XN  >  0,  Therefore,  our  first  POD  element  is 


given  by: 


N 

$1  =  (7) 

i= 1 

where  a}  axe  elements  of  the  first  eigenvector,  V1.  The  remaining  POD  elements,  $<,»  =  2,...,N 


are  obtained  by  using  elements  from  the  remaining  eigenvectors,  V*,  i  =  2, . . . ,  N. 
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If  we  want  our  POD  elements  to  form  an  orthonormal  basis  set,  we  must  impose  the  following 
normalizing  condition  on  the  eigenvectors: 


N 

Vk-Vj  =  £a?af  = 

t=l 

Using  our  imposed  condition  (8),  we  can  show  that  the  are  orthonormal. 
(**,#*)  =  /  $k(x)$k’  {x)dx 

Jn 


N  N 

=  Y^aiN^2Cijaj 

i=l  j= 1 

=  NVk  ■  CVk’ 

=  NXk<Vk-Vk' 

1  Jk  =  Jk' 

0  k  ±  k' 

Therefore,  as  long  as  condition  (8)  is  met,  {$*}  is  an  orthonormal  basis  set. 

3.2  Implementation 

In  order  to  perform  POD  on  our  nasal  cross  section  images,  we  must  first  assemble  the  snapshots  into 
an  easily  accessible  matrix.  We  will  call  this  collection  of  snapshots  U.  Each  snapshot  is  essentially 
a  matrix  itself  (comprised  of  binary  entries)  being  75  x  150  pixels.  We  concatenate  the  rows  of  the 


(8) 
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snapshot  and  transpose  them  to  place  in  one  column  of  U.  Using  P  as  the  number  of  snapshots 
(cross  sections)  in  a  certain  sample,  and  having  11,250  pixels  per  snapshot,  we  form  an  11,250  x  P 
matrix,  U,  which  contains  all  of  the  snapshots  from  one  sample. 

Now  that  we  have  assembled  all  of  our  snapshots,  we  can  easily  calculate  the  average  of  each  row 
using  equation  (2)  and  then  form  our  new  snapshots,  Wu  i  =  1, _ ,  N ,  using  equation  (3). 

The  next  step  is  to  construct  the  matrix  C  so  that  we  can  find  the  eigenvectors  and  eigenvalues 
for  the  problem  CV  ~  XV.  Because  we  have  distinct  values  and  not  a  continuous  function, 

Cik  =  jj  J^Wt(x)Wk(x)dx 

is  equivalent  to 

Cik  =  jf{Wi(x)-Wk(x)) 

We  then  solve  the  eigenvalue  problem,  finding  both  the  eigenvectors,  V\  i  =  1, . . . ,  N,  and  their 
corresponding  eigenvalues,  A,-,  i=l,...,N,  in  descending  order.  We  will  see  later  why  the  order  is 
important. 

Once  we  have  our  eigenvectors,  {F*},  we  scale  them  using  the  following  formula: 


F*  = 


1 


VNTXi 


F‘,  Vi  =  1, . . . ,  jV 


This  ensures  that  the  imposed  condition  (8)  holds,  and  therefore  our  POD  basis  elements  will  form 
an  orthonormal  set. 

Now,  we  need  to  find  our  POD  basis  elements,  i  =  Using  equation  (7),  the  first 

POD  element  is  given  by: 

N 


=  Y,a]Wi 

t=l 

The  other  elements,  i  =  2, . . . ,  N,  are  calculated  in  a  similar  manner.  Once  we  have  all  N  POD 
elements  we  can  start  reconstruction  of  the  cross  sections. 
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3.3  Reconstruction 

Any  snapshot,  can  now  be  reconstructed  using  a  linear  combination  of  our  POD  basis  elements. 

N 

V*  =  U  +  £«***  (9) 

*=1 

with 

4  =  *k-Wj  (10) 

The  above  equations  (9)  and  (10)  will  represent  the  snapshots  exactly.  Now  we  look  at  the  error 
created  by  truncating  the  series  in  equation  (9). 

3.4  Error 

If  we  use  an  approximation  to  equation  (9) 

M 

ujM  =  v  +  (ii) 

k- 1 

where  M  «  N>  we  have  introduced  an  error  into  our  reconstruction.  The  error  is  calculated  as 


follows: 

Error  = 

or 

\\u\  1 

w  Error  _  number  of  pixels  incorrect  j(  m 

(12) 

3.5  Density 

total  number  of  pixels 

We  need  a  method  to  discover  an  acceptable  M  in  equation  (11)  before  we  run  all  of  our  calculations. 
We  want  (11)  to  be  a  good  approximation  to  (9).  In  previous  studies  of  fluid  flow  [4,  12]  the  data 
fields  analyzed  are  fields  of  velocities.  When  constructing  a  sum  of  the  squares  of  these  velocities, 
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the  author  creates  a  formula  akin  to  kinetic  energy.  We  would  like  to  study  a  comparable  quantity 
in  our  observations  of  the  fields  of  binary  data  representing  nasal  cross  sections.  We  will  use  the 
same  type  of  analysis  as  found  in  [4,  12]}  but  will  refer  to  our  function  as  Density. 

The  density  of  the  system  is  a  way  to  measure  an  acceptable  M  quantitatively.  Density  is 
calculated  using  the  following  formula: 

*  yM  a* 

%  Density  =  ■  x  100  (13) 

where  M  is  the  number  of  POD  elements  used  and  N  is  the  total  number  of  POD  elements  available. 
The  AjS  are  the  eigenvalues  associated  with  the  POD  eigenvectors.  Since  we  have  ordered  the 
eigenvalues  with  the  largest  first,  we  capture  most  of  the  density  in  the  first  few  eigenvalues,  and 
therefore  in  the  first  few  POD  elements. 

4  Results 

W  hen  the  regeneration  of  the  data  takes  place,  each  pixel  is  returned  with  a  grey  scale  value,  i.e. 
each  pixel  value  €  [0, 1].  This  must  be  converted  to  a  black  or  white  value  in  binary  form.  If  the 
pixel  returns  a  value  less  than  0.5,  it  is  assigned  a  'value  of  0,  If  the  returned  value  is  greater  than 
or  equal  to  0.5,  it  is  assigned  a  value  of  1. 

All  results  are  calculated  on  a  Windows  station  with  a  Pentium  II  processor  using  Matlab  5.3.1. 

4.1  Regenerating  Sample  02  Using  Its  Own  POD  Elements 

The  first  analysis  consisted  of  using  POD  on  the  cross  sections  of  Sample  02  and  regenerating  that 
same  sample.  A  total  of  fifty-four  snapshots  were  available  in  the  sample.  Variable  numbers  of  POD 
elements  were  used  to  regenerate  the  data  (54,  40,  30,  20,  10  and  5)  and  the  density  was  calculated. 
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a  a  a  s 

Figure  2:  Sample  02  -  Original  snapshots 

a  a  3  § 

Figure  3:  Sample  02  -  Reconstruction  using  54  elements 

The  time  shown  is  the  time  to  construct  POD  elements,  calculate  density  and  reconstruct  the  data. 
The  construction  of  the  POD  elements  takes  117  seconds.  Results  follow  in  Table  3.  Figure  2  shows 
the  first  four  cross  sections  of  Sample  02.  Figures  3-6  show  the  first  four  snapshots  represented 
by  54,  40,  20  and  5  elements,  respectively.  Notice  that  we  cannot  see  much  of  a  difference  between 
the  original  snapshots  and  the  reconstruction  of  Sample  02  until  we  are  only  using  five  elements. 
Using  five  elements  cuts  the  processing  time  by  forty-six  percent.  In  a  larger  problem,  this  could  be 
a  significant  decrease*  in  computing  time. 


Table  3:  Sample  02 


No.  of  elements 

Density  (%) 

Time  (sec.) 

Error  (%) 

54 

100.00 

225.36 

0.00 

50 

99.52 

214.76 

0.003 

40 

96.10 

194.32 

0.105 

30 

89.88 

174.50 

0.369 

20 

80.16 

153.85 

1.4171 

10 

63.35 

133.80 

4.377 

.  5 

47.36 

123.47 

7.507 

3  a  a  a 

Figure  4:  Sample  02  -  Reconstruction  using  40  elements 

3  a  a  a 

Figure  5:  Sample  02  -  Reconstruction  using  20  elements 


4.2  Base  Sets 

In  order  to  determine  if  the  population  can  be  represented  adequately  by  a  smaller  set  of  data,  we 
choose  a  small  number  (four,  five,  or  six)  of  the  samples  to  construct  a  base  set.  POD  is  performed 
on  the  collection  of  snapshots  from  the  chosen  samples  to  form  a  base  set  of  N  snapshots.  In  this 
paper,  we  use  four  different  base  sets. 

The  bases  formed  by  implementing  POD  on  each  of  the  base  sets  were  used  to  regenerate  the 
fourteen  sets  of  data  using: 

1.  all  available  POD  elements  (100%  density) 

2.  enough  POD  elements  to  capture  90%  of  the  density 

3.  ten  percent  of  the  POD  elements  (variable  density) 

3  3  3  3 

Figure  6:  Sample  02  -  Reconstruction  using  5  elements 
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The  following  tables  (Tables  4-7)  show  the  Total  Error,  Average  Error,  Density,  and  Time.  The 
Total  Error  is  the  sum  of  the  errors  generated  by  using  N  (or  M)  of  the  available  POD  elements 
to  regenerate  each  of  the  fourteen  Samples.  The  Average  Error  is  the  average  of  the  errors  when 
regenerating  all  of  the  Samples  using  N  (or  M)  of  the  available  POD  elements  to  regenerate  each 
sample.  The  Density  is  defined  by  equation  (13).  The  Time  is  the  time  to  construct  the  POD 
elements,  read  in  the  Sample  14  file  and  reconstruct  and  plot  the  regenerated  Sample  14.  (Sample 
14  is  used  as  an  example  so  that  the  reader  can  experience  the  regeneration  of  a  sample  visually.) 


4.2.1  Base  Set  1 


Base  Set  1  consisted  of  Samples  02,  03,  12  and  18  for  a  total  of  214  snapshots.  The  implementation 
of  POD  on  Base  Set  1  constructed  N  =  214  POD  elements,  which  were  then  used  to  reconstruct 
each  sample.  First,  all  of  the  214  POD  elements  were  used  (100%  density).  Then  eighty-six  POD 
elements  were  used  (90%  density).  Finally,  ten  percent,  or  twenty-one  POD  elements,  were  used 
to  reconstruct  the  samples.  The  results  are  shown  in  Figure  7  and  Table  4.  The  generation  of  all 
214  POD  element  took  2821  seconds.  Using  Sample  14  as  an  example,  the  original  snapshots  and 
reconstructed  snapshots  are  shown  in  Figures  8-10. 

We  can  see  that  using  only  twenty-one  POD  elements  yields  an  image  that  is  significantly  different 
than  the  original.  However,  using  eighty-six  POD  elements  is  only  slightly  different,  with  an  error 
of  3.35%.  Using  eighty-six  POD  elements  reduces  the  computational  time  by  54%. 


Table  4:  Base  Set  1 


Elements 

Total  Error (%) 

Average  Error(%) 

Density  (%) 

Time  (sec.) 

N=214 

32.29 

2.31 

100 

7021 

M=21 

86.41 

6.17 

65 

3221 

M=86 

42.69 

3.05 

90 

3852 
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Sample 

Figure  7:  Base  Set  1 


«  t  i  £ 

Figure  8:  Sample  14  -  Original  snapshots 


4  4  i  4 

Figure  9:  Sample  14  -  Reconstruction  using  214  POD  elements  of  Base  Set  1 


44  i  i 

Figure  10:  Sample  14  -  Reconstruction  using  86  POD  elements  of  Base  Set  1 
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Figure  11:  Sample  14  -  Reconstruction  using  21  POD  elements  of  Base  Set  1 
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Sample 

Figure  12:  Base  Set  2 

4,2,2  Base  Set  2 

Base  Set  2  consisted  of  samples  02,  03,  12, 14,  and  18  for  a  total  of  274  snapshots.  The  POD  of  Base 
Set  2  resulted  in  a  total  of  N  =  2/4  POD  elements  (which  took  a  total  of  6805  seconds  to  generate). 
The  results  are  shown  in  Figure  12  and  Table  5.  Figures  13  -  10  show  the  first  four  reconstructed 
cross  sections  of  Sample  14. 

Using  twenty-seven  POD  elements  generates  a  visual  difference  that  is  slightly  different  from  the 
original,  with  only  7.54%  error.  Reconstruction  using  twenty-seven  POD  elements  reduces  the  time 
by  78%. 

4  4  4  i 

Figure  13:  Sample  14  -  Original  snapshots 


til 


Table  5:  Base  Set  2 


Elements 

Total  Error(%) 

Average  Error(%) 

Density  (%) 

Time  (sec.) 

N=274 

22.95 

1.64 

100 

31949 

M=27 

73.62  ■ 

5.26 

68 

7105 

M=101 

33.42 

2.39 

90 

8461 

14^ 

Figure  14:  Sample  14  -  Reconstruction  using  274  POD  elements  of  Base  Set  2 

4.2.3  Base  Set  3 

Base  Set  3  consisted  of  Samples  02,  03,  12,  14,  18  and  19  totaling  326  snapshots.  Performing  POD 
on  Base  Set  3  resulted  in  a  total  of  N  =  326  POD  elements,  which  took  13,224  seconds  to  generate. 
The  results  are  shown  in  Figure  17  and  Table  6.  Figures  18  -  20  are  the  first  four  reconstructed  cross 
sections  of  Sample  14. 

•Reconstruction  of  Sample  14  does  not  show  a  visual  difference  until  we  use  only  thirty-three 
POD  elements.  The  error  here  is  3.02%  while  the  time  is  reduced  by  88%. 


Table  6:  Base  Set  3 


Elements 

Total  Error(%) 

Average  Error(%) 

Density  (%) 

Time  (sec.) 

N=326 

16.61 

1.19 

100 

119640 

M=33 

62.99 

4.50 

69 

14608 

j  M=115 

25.85 

1.85 

90 

17946 
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Parc  «)t  Error 


Figure  15:  Sample  14  -  Reconstruction  using  101  POD  elements  of  Base  Set  2 


4  4  3  3 

Figure  16:  Sample  14  -  Reconstruction  using  27  POD  elements  of  Base  Set  2 
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Figure  IT:  Base  Set  3 

4  4  i  i 


Figure  18:  Sample  14  -  Original  snapshots 


4  4  i  i 

Figure  19:  Sample  14  -  Reconstruction  using  326  POD  elements  of  Base  Set  3 


44^ 

Figure  20:  Sample  14  -  Reconstruction  using  115  POD  elements  of  Base  Set  3 


44H 

Figure  21:  Sample  14  -  Reconstruction  using  33  POD  elements  of  Base  Set  3 
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Figure  22:  Base  Set  4 

4,2.4  Base  Set  4 

Base  Set  4  consisted  of  Samples  02,  03,  12,  14,  and  19  totaling  266  snapshots.  The  POD  resulted  in 
a  total  of  N  =  266  POD  elements,  which  took  6,034  seconds  to  generate.  The  results  are  shown  in 
Figure  22  and  Table  7.  Figures  23  -  25  show  the  reconstructed  first  four  cross  sections  of  Sample  14. 

In  this  Base  Set,  we  cannot  see  a  visual  difference  until  we  are  only  using  twenty-seven  POD 
elements.  By  using  twenty-seven  POD  elements,  we  reduce  the  time  by  32%,  but  increase  the  error 
by  only  7.02%. 


Table  7:  Base  Set  4 

Elements  |  Total  Error(%)  I  Average  Error(%)  |  Density  (%)  |  Time  (sec.) 

N=266 _ 22.73 _ L62 _ 100  9689 

M=2? _ 74.78 _ 5JM _ 67  6606 

M=102  I  32.97  I  OS  1  90  I  7407 
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Figure  23:  Sample  14  -  Original  snapshots 
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Figure  24:  Sample  14  -  Reconstruction  using  266  POD  elements  of  Base  Set  4 
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Figure  25:  Sample  14  -  Reconstruction  using  102  POD  elements  of  Base  Set  4 


4  4  i  3 

/ 

Figure  26:  Sample  14  -  Reconstruction  using  27  POD  elements  of  Base  Set  4 


21 


5  Reconstructions  Based  on  Error 


To  determine  whether  the  samples  provided  can  be  reconstructed  within  reason,  an  error  tolerance 
must  be  set.  Since  the  particular  use  of  the  POD  technique  will  dictate  the  resolution  desired  in 
reconstruction,  it  can  be  expected  that  different  tolerances  might  be  required  in  various  applications. 
To  illustrate  the  POD  capabilities  at  one  level,  we  choose  an  error  (as  defined  in  equation  12)  of  5% 
as  acceptable. 

5.1  Using  Base  Sets  to  Reconstruct  Each  Sample 

POD  elements  generated  from  the  four  different  base  sets  are  used  to  represent  each  of  the  fourteen 
samples.  The  number  of  elements  needed  from  each  base  set  to  reconstruct  the  samples  within  the 
stated  error  tolerance  are  plotted  on  Figure  27. 

Upon  reconstruction  of  the  data,  it  was  observed  that  when  the  snapshots  from  a  certain  sample 
are  used  to  form  the  Base  Set,  it  takes  less  elements  from  that  Base  Set  to  reconstruct  that  sample. 
For  example,  the  snapshots  from  Sample  19  are  used  to  form  Base  Set  3  and  Base  Set  4.  We  can  see 
from  Figure  27  that  it  takes  twenty-six  elements  from  Base  Set  3  and  twenty-three  elements  from 
Base  Set  4  to  reconstruct  Sample  19  within  the  tolerance.  However,  it  takes  ninety-four  elements 
from  Base  Set  1  and  eighty  elements  from  Base  Set  2  to  meet  the  error  criterion  when  reconstructing 
Sample  19. 

5.2  Using  Each  Sample  to  Reconstruct  Itself 

In  this  experiment,  each  sample  is  used  as  its  own  Base  Set.  For  example,  POD  is  performed  on 
the  cross  sections  from  Sample  02.  The  basis  that  is  formed  is  used  to  reconstruct  Sample  02.  This 
is  then  repeated  for  each  of  the  other  thirteen  samples.  The  number  of  basis  elements  needed  to 
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Figure  27:  Base  sets  1-4  reconstructing  each  sample 


reconstruct  the  original  cross  sections  within  the  error  tolerance  is  determined  and  the  results  are 
shown  on  Figure  28. 

An  average  of  eight  POD  elements  are  needed  to  reconstruct  each  sample  with  its  own  Base 
Set  within  the  error  tolerance.  (There  is  an  average  of  fifty-four  POD  elements  constructed  in 
each  Sample.)  Less  than  twenty  percent  of  the  available  POD  elements  are  needed  on  average  to 
reconstruct  the  samples. 


6  Conclusions 

As  one  might  expect,  fewer  elements  are  needed  to  represent  the  samples  that  are  in  the  Base  Set 
as  compared  to  the  samples  outside  of  the  Base  Set.  As  more  snapshots  are  added  to  a  Base  Set, 
it  becomes  easier  to  represent  a  Sample.  However,  adding  more  snapshots  increases  the  computing 
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Figure  28:  Number  of  elements  From  each  sample  needed  to  reconstruct  its  own  cross  sections  with 
less  than  5%  error. 


time.  Therefore,  we  need  a  well  chosen  Base  Set  to  represent  the  field  of  data. 

We  have  shown  that  Proper  Orthogonal  Decomposition  can  be  an  effective  tool  to  represent 
human  nasal  cross  sections  with  an  error  tolerance  specified  by  the  user.  With  an  acceptable  error 
of  5%,  each  of  the  fourteen  samples  was  represented  with  less  than  half  of  the  available  POD  elements. 
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